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ABSTRACT 

To aid in evaluating the First Year Communication 
Skills Program (FYCSP) and the Instructional Concepts Program (ICP) 
several tests were administered to two classes of kindergarten 
children. The objectives of the ICP were based on "concepts that 
children would be expected to know when they entered the primary 
grades. The Instructional Concepts Test (ICT) measured the children's 
knowledge of these concepts. Items were constructed for each of the 
following categories: shapes, sizes, positions, amount^ and 
premathematics. Among the tests that were administered to the 
children^ were word attacks, word elements, and letter names. Student 
and parent attitudes were also surveyed as to their opinions of the 
program. The data collection of test results shows that both programs 
had been successful with kindergarten children. The program also 
proved to be well liked by children and parents- (Author/DEP) 
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ABSTRACT 
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Several tests of general ability and reading skills were 
administered to kindergarten children using the Instructional Concepts 
Program and the First-Year Communication Skills Program together with 
SWRL programs in Art, Music and Drama. These test data are reported 
in this paper. 
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EVALUATION OF THE FIRST-YEAR COMMUNICATION SKILLS 
• AND INSTRUCTIONAL CONCEPTS PROGRAMS 

Several tests were administered tq two classes using the Instructional 
Concepts Program (ICP) and the First-Year Communication Skills Program 
^FYCSP) during the L970-1971 school year. The purpose of this evaluation 
was to determine the instructional effectiveness of the programs. Data 
from these tests are summarized in this paper. 

PROCEDURES 

Tryout Population * ^ 

Two classrooms in one school took part in this evaluation of the 
Inst;ructional Concepts and First-Year Communication Skills Programs. 
The school serves a predominantly urban> middle-class population. The 
kindergarten children were divided on the basis of age; older children 
were assigned to one classroom, younger children to the other. Both of . 
the teachers had been participants in earlier FYCSP tryouts but were 
unfamiliar with the Instructional Concepts Program. 
Instructional Outcomes 

The objectives of the Instructional Concepts Program were based upon 
an analysis of first-grade curriculum guides used in Southern California. 
These materials make certain implicit assumptions concerning the conceptual 
abilities of first graders. For instance, the curriculum guide which 
advises, "Tell the children to turn to the top of the next page," implies 
that students will know concepts such as "turn," "top," "next" and "page." 
Concepts which occurred in at least two of the curriculum guides and which 
did not refer to specific objects (e.g., house, dog, tree, etc.) were 
adopted for the program* This list of concepts was revised on the basis 
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of suggestions from primary-grade teachers and curriculum specialists. 
The revision was also the result of individual assessment of kindergarten 
children on tasks involving use of various concepts • The result was a 
list of 96 concepts grojuped into the following categories: colors, sizes, 
shapes, amounts, positions, pre-raathema tics and pre-reading. In addition, 
a number of direcr.ion- following and test-taking skills are taught in the 
program. A list of the concepts in each concept category appears in 
Appendix A. 

The outcomes of the First-Year Communication Skills Program include: 
(I) words--a reading vocabulary of approximately 100 words, (2) word 
elements--the ability to read 23 selected initial and ending sounds, 
(3) word-attack — the ability to sound out and read any one-syllable 
word composed of word elements from the program and (4) le.tter names-- 

the ability to name each letter of the ^Iphabet when shown the printed 

f 

letter. A more detailed listing of the^e outcomes together with the 
sequence in which they are learned can be found in Appendix B. 
Instructional Materials | 

The Instructional Concepts Program consists of 58 daily lessons 
divided into seven ynits. In each unit, children are introduced to the 
content by a series of lessons termed "initial instruction." Each of 
these lessons focuses upon two, three or four concepts. After the 
initial instruction on each unit, one day is set aside for asse'ssment 
of the children's concept skills. '*he next two days are devoted to 
"second instruction," a time for review and to help children who had 
trouble learning the concepts. 
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The following instructional materials are provided: stories, 
story posters, concept books, flashcards, games, concept cards, criterion 
and practice exercises, procedure cards, a file box and a teacher's 
manual, A complete description of these materials can be found in an 
earlier Laboratory document (Scott and Martin, 1970). 

The First-Year Communication Skills Program consists of ten units. 
Each unit includes instructions relating to the program outcomes, an 
assessment exercise and follow-up instruction. 

The program includes storybooks, flashcards, comprehension sheets, 
criterion and practice exercises, procedure cards, an oral word and a 
game index, good work badges and a teacher's manual. A description of 
these materials can be found .in another Laboratory document (Sullivan, 
1971). 

/ 

/ 

Data Collected 

The Instructional Concepts Test meastires children's knowledge of a 
sample of concepts included in the program outcomes. Three items were 
constructed for each of the following coricept categories: shapes, sizes, 
positions, amounts and pre-mathem^'tics. The required response is the 
identification of the orally presented concept by pointing. The test 
contains fifteen items, each consisting of a picture illustration of a 
concept and one or two disjtractors. Laboratory staff members individually 
administered the test us/ing the script and recording form included in 
Appendix C. 

A 50-item test assessed performance on the four outcomes of the 
First-Year Communication Skills Program, This test contains 10 items 
each covering program words, word elements, word-attack and letter name^. 
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Each set of 10 items consists of five selected-response items and 
five constructed-response items. The test wao individually administered 
by Laboratory staff members • Appendix C includes the test script and 
recording form. 

Form 12A of the Cooperative Primary Reading Test was used to provide 
an additional measure of children's reading skills. This test consists 
of 50 selected-response items and is group-administered. National and 
California norms for first-grade students are available.. 

Two tests of the Metropolitan Readiness Battery were administered 
to provide supplementary measurements of word. meaning and alphabet 
skills. Each of these tests consists of 16 three- or four-choice 
selected-response items. National norms for kindergarten children are 

/ 

available for both tests. / 

Student attitudes toward the instructional materials was measured 
by a questionnaire which asked children to describe the extent of their 
participation in and attitudes toward ten classroom activities. Each 
question was asked by a Laboratory staff member in an individual inter- 
view. Another ques t;Lonnaire was sent to parents of each child in the 
tryout classes. It^ was designed to determine the extent to which 
parents believed the instructional programs were important and liked 

r 

by the children. 

Several classroom observations were conducted in both tryout classes. 
The major purpose of these observations was to measure time commitments 
to various classroom activities. The tryout teachers were interviewed 
many times during the school year. They were asked to give candid 
comments on all aspects of the tryout. 

6 
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RESULTS AND DISCUSSION 

Test Results 

Instructional Concepts * This program was used systematically with 
only a small number of children. At the beginning of the school-year, 
both tryout teachers believed that most of their students had already 
mastered 'a majority of the program's objectives. Because the most 
extensive use of the program was with the class to which the younger 
children were assigned, the posttest of the Instructional Concepts Program 
was administered only to this group. The mean score for 26 children 
tested was 14.0 on the i5-item test, '^'he standard deviation was 1.2. ' 

This /compares favorably with 'a posttest mean .of 12.2 and a standard 

/ 

deviation of 2.3 for 368 students in an earlier tryout (Scott and 
Martin, 1970). 

First-Year Communication Skills . Children enrolled in the tryout 
classes made substantial gains in reading skills during the school year. 
Table 1 reports the scores of tryout classes on the First-Year Communica- 
tion Skills Program posttest. Scores for each outcome-area — words, word 
elements, word -attack and letter names — were very close to or above 
scores of first-grade children reported in a previous tryout (Sullivan 
and Majer, 1970). Of the two tryout classes, the class with the older 
children had higher mean scores in each outcome area. However, the 
differences were small--ranging from one to seven percent. 
^ Table 2 contrasts the Cooperative Reading Test scores of the tryout 
classes with the scores of a kindergarten class which did not use the 
Laboratory's Communication Skills Program, Scores based up^n national 
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TABLE 1 

MEAN PERCENTAGE CORRECT FOR FIRST-YEAR 
COMMUNICATION SKILLS POSTTEST 



Mean Percentage Correct 



Program Outcomes 



Group 


Number 

of y 
Children Words 


Word 
Elements 


Word Letter 
Attack Names ' 


Totals 


Tryout Class 
with Younger 
Children 


26 88 


91 


74 92 


86 


Tryout Class 
with Older 
Children 


27 , 89 


97 


79 99 


91 


1969-1970 
Tryout- 


105 89 


93 


67 93 


87 


"Program tryout reported by Sullivan and Majer, 1970. 








TABLE 2 








ITEMS CORRECT 
READING 


FOR COOPERATLVE PRIMARY 
TEST— FORM 12A 






Kindergarten 

Tryout 

Classes 


Kindergarten Flrst-Grade Spring Norms 
Control California National 
Class (1970) (1966) 


First 
Quartile 


16.0 


3.0 


17.6 


18.0 


Median 


21.2 


6.0 


22.4 


22.8 


Third 
Quartile 


26.0 


9.0 


31.2 


29.6 
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and California first-grade norms are also included. As., expected, the 
scores of the kindergarten control class were very low^-below chance 
levels since many children stopped before they had completed all items. 
The mean scores for the kindergarten classes using the Communication Skills 
Program indicated that these children were very close to the reading 
ability scores of an average first-grade class. The correlation between 
the scores on the Laboratory developed post test and the Cooperative Reading 
Test was .51. 

Several children made relatively low s.cores. Ten of 33 scores in the 
class of younger children were below the fifth percentile of first-grade 
norms; two of 31 scores were beiow the same level in the cl^ss of older 
children. Other kindergarten ':hildren had scores much higher than average 
first-grade r.esults. Fourteen of 64 scores were above the national norm 
median for second-grade fall testing. Despite the existence of these high 
and low extremes, the distribution of scores in the tryout classes was 
similar to the average first-grade class. The standard deviation reported 
for national first-grade spring norms and the standard deviation for the 
tryout classes are both 9.1. 

The word ^meaning and alphabet tests of the Metropolitan Readiness 
Battery were selected because they are closely related to achievement in 
reading. Scores of tryout classes and comparative figures from national 
norms are listed in Table 3. For the 16-item word meaning test, the mean 
of 61 tryouc students was 10.10 compared with a national norm of 8.67. 
The superiority of the tryout classes was even larger on the 16-item 
alphabet cest--14.5'l versus a national norm of 9.39. 
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TABLE 3 

ITEMS CORRECT FOR TWO 16-ITEM TESTS OF THE 
METROPOLITAN READINESS BATTERY 





Word Meaning 


Alphabet 






Tryout 


Nationa 1 


Tryout 


National 




Classes 


Norms 


Classes 


Norms 


First 










Quartile 


9 


6 


14 


5 


Median 


10 


9 


16 


10 


c 

Third 


12 


11 


16 


14 


Quartile 











Children's Attitudes 

The children in both tryout classes were individually interviewed 
and were asked questions relating to how well they liked various school 
activities. Six of the activities were part of Laboratory programs; four 
others were selected from activities in which the children frequently 
participated. Children were first asked whether they remembered partici- 
pating in a particui^r activity. A sample of instructional materials was 
shown to^ tbe-'^chnd^ a t this time. At least 49 of the 53 children inter- 
viewed indicated that they had participated in eight of the ten class- 
room activities. A slightly smaller number had used the state adopted 
redding text and only 12 had used the Instructional Concepts Program books. 
Follow-up questions for each activity asked the child whether he liked the 
activity and, if so, did he like ic *'just OK,!* "a lot" or "a whole lot.'* 
Very few children reported that they did not like any of the activities. 
For each activity more than 407^ of the children said that they liked it 
"a whole lot/* The highest percentage of favorable comments was recorded 
for the small sample of children who had used the Instructional Concepts 
books. For the remaining activities, there were no major differences 
between the response patterns of Laboratory and non-Laboratory programs. 

10 



-9- 



Parent Questionnaire 

A questionnaire was sent Co parents of tKe children participating in 
the tryout. Twenty-nine of 62 questionnaires were returned to the Laboratory. 
The questionnaire asked parents to check the extent to which they agr^d or 

A 

disagreed with the following statements: 

1. My child learned important things from the SWRL pi:;6grams. 

2. My child liked the materials in the programs. 

3. The SWRL programs should be used in kindergarten again next year. 

\ 

Parents were encouraged to add any additional comments that they wished 
to make concerning the programs. 

The parent response to the Laboratory programs was highly positive. 
All o.f the 29 parents who returned uhe questionnaire agreed that their 
child had learned important things from the programs, liked the materials, 
and that the programs should be used in kindergarten again next year. The 
percentage of each response for these questions is listed in Table 4. 

TABLE 4 

PARENT RESPONSES TO 
PROGRAM QUESTIONNAIRE 



Questionnaire 
Statement 



I agree 
very much 



Percentage of Responses 
I agree I disagree 



My child learned 72 
important thingi? 
from the SWRL 
programs. 

My child liked 79 
the materials in 
the programs. 

The SWRL programs 79 
s'hould be used in 
kindergarten again 
next year. 



28 



21 



21 



I disagree 
very much 
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Pacing and Time Requirements of the Programs 

Both tryout teachers' felt that only a small number of the children 
in their classes lacked the skills taught in the Instructional Concepts 
Program, Therefore, the complete program was only used with these 
children. Other components of the program such as the stories were used 
with the entire class. The program was used at a pace close to the sug- 
gested one-lesson-per-day • 

Both teachers began the First-Year Communications Skills Program at 
the beginning of the school year and devoted more time to the program 
activities than the 25 minutes per day suggested in tne Teacher's Manual. 
Classroom observations showed that in the fall, reading instruction averaged 
37 minutes per day. In the spring, this f igure^^ncreased to 58 minutes. 

Soon after the school year began, both classes were divided into three 
^e^ding groups on the basis of ability. All groups completed the ten 
program units and many of the children proceeded on to the primers of "-he 
state adopted reading series. 
Conclusions 

The data collected in this tryout show that- kindergarten children 
can develop a high level of reading skill. Equally important is the fact 
that the programs were well liked by the children, their parents and the 
teachers. These data indicate that in the hands of a skilled teacher, the 
Laboratory's instructional materials can be an important part of a success- 
ful kin.dergarten program. 
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APPENDIX A 

INSTRUCTIONAL CONCEPTS PROGRAM 
CONTENT CHART 



LESSON 
NUMBER 



LESSON CONTENT 



LESSON 
NUMBER 



LESCON CONTENT 



COLORS AND DIRECTIQN- FOLLOWING SKILLS 

1 Red, Blue 

2 Yellow, Black 

3 White, Brown 

4 Green, Purple 

5 Orange, Pink 

6 Row, Numerals 1 ^to 5 

7 Turn, Page, Mark 

8 Criterion Exercise 

9 First Review 

10 Second Review 

SIZES 

11 Larger, Smaller, Largest, Smallest 

12 Shorter, Longer, Longest 

13 Shorter, Taller, Shortest, Tallest 

14 Thicker, Thinner 

15 Criterion Exercise 

16 First Review 

17 Second Review 

AMOUNTS 

18 One, Two, Three, Four 

19 Five , Six, Seven 

20 Eight, Nine, Ten 

21 All, Some, None, No 

22 More, Less, Most, Least 

23 Criterion Exercise 

24 'Eirs.t Review 

25 Second Review^ 

SHAPES 

26 Circle, Square, Triangle 

27 Rectangle, Straight and Curved 

Lines 

28 Criterion Exercise 

29 First Review 

30 Second Review 



POSITIONS 

31 Front, Back, Middle 

32 Top, Bottom, Side 

33 Behind, In 'Front, Between 

34 Beside, Next To, Around 

35 Above, Below, Over, Under 

36 Inside , Outside 

37 "Right, Left 

38 First, Last , Beginning-, End 

39 First, Second, Third, Fourth 

40 Criterion Exercise <fzr 

41 First Review 

42 Second Review 

COMPARISONS AND COMBINATIONS 

43 Equal , Unequal (Amount) 

44 Same, Different (Size, Shape, 

Color, Amount) 

45 Not (Equal or SameJ 

46 Combined Colors & Shapes 

47 Combined Colors & Sizes, Shapes 

&t Sizes 

48 Combined Shapes & Positj.ons, 

Sizes & Positions 

49 Criterion Exercise 

50 First Review. 

51 Second Review 

PRE-READING 

52 First, Last (Time) 

53 Before, After (Tinie) 

54 Letter, Word 

55 Sound, Name 

56 Criterion Exercise 

57 First Review 

58 Second Review 



ERJC 
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APPENDIX B 



FIRST- YEAR COMMUNICATIONS SKILLS PROGRAM 
CONTENT CHART 



U OUTCOME NUMBER* 



N 
I 
T 


1 


2 


3 




4 






Word 


Word 


Lettfier 




Words 


Elements 


Attack 


Names 




1 
1 


1 ^SJTTl COO mo Mat* 
X, Odllt, dec, am, lUc , 1 la L 


o , III , a u 


Rv TIn^^ S And 


s, 
a. 


m, 
i. 


e, 

4- 


2 


Mit, Sis, meet, in, it, 
sit, on, is 


it,* eet 


thereafter, the 
children should 


n, 


o» 


h 


3 


sat, Ann, this, and. Nan, 
- a, man, the 


th, an, 
n 


De aoie co o ounu 




f. 


d 


4 


mad, that, at, Sid, we, 
will, 'with, fell, mess 


ad , w , 
ill, f 


out and read any 
one-syllable word 


1, 


r . 


b 


5 


fit, Nat, sun, them, us, 

WllaL, i.CCL, i.UIl, LUll 


un, r 


composed of word 


u. 




y 


6 


Nell, who, yes, did, Ed, 
let, well, need, she 


ell, et, 
1, eed 


elements taught 
previously in the 








7 


net, ran, sad, no, fill, 
sheet, shut, mud 


ut, sh 


program^ 


p. 


k. 


g 


8 


sand, sell, shell, fish, 
hat, he, then, nut, rat, 
set, feel, not, fat, if, 
wet 


en, h 










9 


fan, win, hand, hill. 


b 












seed, weed, met, hit. 






q. 


V 






was, to\ bad, him, men, be 











10 bat, his, wish, ball, 
bell, but, has, said, 
ant, Ben, bus, had, bed, 
bee. Bill, hid 



Outcome 1: Words that the children learn to read 

Outcome 2: Beginning and ending sounds that the children learn to read 
Outcome 3: Word-attack skills that the children learn to apply 
Outcome 4: Letter names, both for capital and lower-case letters, that 
the children learn to say when shown the letters 
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APPENDIX C 



PUPIL RECORD FORM 

INSTRUCTIONAL CONCEPTS PROGRAM 
DIAGNOSTIC TEST 



CARD 



Student 
Teacher 
School 
AM or PM 



WARM-UP EXERCISE 



A. Point to the yellow butterfly. 

B. Point to the white hat. 



SHAPE 

1. Point to the square. 1. 

2. Point to the trianqle. I. 

3. Point to thf* rectangle. I 

SIZE 

4. Point to tn»» thinner sandwich. 1 

5. Point to the largest turtle. 1 

6. Point to the shorter lizard. 1 

POSITION 

7. Point to the cat at the end of the 1 
I mt, . 

8. Point to the bird m front of the 1 



Point to the cat that is beside 1 
thv star. 

10. Point to tho pond with no ducks. 3 

11. Soe this box of apples? (Point to 
oni' box.) Sec this box of apples? 
n'< :nt to other box.) 

Point to the box with 3 apples. I 

12. .See this box of marbles? (Point to 
ono box.) See this box of marbles? 
(Point to other box.) 

Point to Che box with 5 marbles. I 
PF'J.-MATHEMATICS 

13. Point to the green mouse beside the 1 
box. 

14. Point to the larger rectangle. 1 

15. See this cat? (Point to the cat 

m the nargm.) Point to a cat 1 
that IS a different size. 



•Corrii-ct rfosponse 
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